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Abstract 
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1 Introduction. The weighted entropy-power inequality 


Let X G M I—)• (f){x) > 0 be a given (measurable) function. The weighted differential entropy 
(WDE) K^{Z) of a real-valued random variable (RV) Z with a probability density function 
(PDF) fz is defined by the formula 

^^('2') = h^ifz) ■= -E(j){Z)ln fz(Z) = - [ 4>{x)fzix)ln fzix)dx, (1.1) 

assuming that the integral is absolutely convergent (with the usual agreement that 0 • In 0 = 0). 
Cf. [U, |2], [7]. For (f){x) = 1, the definition yields the standard (Shannon) differential entropy 
(SDE). Furthermore, (j) is called a weight function (WF). When we say that h'^{Z) is finite we 
mean that RV Z has a PDF fz, and the integral in (jl.ip absolutely converges. 

We propose the following bound which we call the weighted entropy-power inequality (WEPI): 
for two independent RVs Xi and X 2 , with X = Xi + X 2 , 
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( 1 . 2 ) 
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assuming that the WDEs K^{X), K^{Xi) and h^(X 2 ) are finite, as well as the expected values 
E0(X),E(/)(Xi),E(^(X 2 ) (the latter means that E(/)(X),E(/)(Xi),E(/>(X 2 ) E (0,oo)). Again, for 
4>{x) = 1, this yields the famous EPI put forward by Shannon; see |3], | 8 ], [1], |5]. In this note we 
offer a sufficient condition for (see Eqns m and (| 1 . 6 p below); the origins of bound (ll. 6 p 

go back to Ref. [U]. We set: 
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and 


K = exp 


2h;(X,) 

E 0 (Ai) 


+ exp 


2h;(X2) 

Ec/>(X2) 


(1.4) 


Theorem 1: Given independent RVs Xi, X 2 and a WF (j), set X = Xi + A 2 and make the 
following suppositions, (i) The expected values obey 

E(/)(Xi) > E0(X) and E(f>(X 2 ) >E(f>(X) ifK>l, 

E(j){Xi) <E(j){X) and E^(Xa) < E(^(A) ifK<l. 

(ii) With a and Y 2 , Y 2 as in Eqn (11.31) . 

(cosa)2 /i-jTi) + (sina)2 (Ta) < h;{X). (1.6) 

Here 


(pcix) = cos a), (^ 3 ( 3 ;) = <(>( 2 ^ sin a) (1-7) 

and we assume finite WDEs h^{X) and 

hJ^iY2) = -EMY2)lnfY,{Y2), hJ^{Y2) = -E<))s(R2) In/y,(y2). 

Then WEPI (II.2p holds true. 


Proof: We can write 


hJiXi) = /i^jTa) +E())(Xi)log COSO, hJ{X 2 ) = (Ta) + E())(X 2 ) log sina. 

Using we have the following inequality: 

f^'^iX) > (cosa)^ h^{Xi) — E(/>(Xi)log cos a 

+ (sina!)^ /i^(X 2 ) - E 0 (X 2 ) log sina 
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Furthermore, recalling (ll.4p we obtain: 


hJ{X) 

Ecj){X2) 

By virtue of assumption (11.51) . we derive: 

h;{x) > ^iE0(x)iog 

The definition of k in Eqn (II.4p leads directly to the result. □ 
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Paying homage to Ref. |^, we call the bound (|1.6p the WLSI (weighted Lieb's splitting 
inequality). In the spirit of j6], the following Theorem 2 can be offered. (The notation used in 
Theorem 2 is self-explanatory; the proof of Theorem 2 is one-line and omitted.) 


Theorem 2: Let f and g be PDFs on M and (p a given WF. Assume that the WDEs 
* d); ^^(/) hnite, as well as expected values E,f cp, Eg (p. Set 


T = exp 


2fe^(/) 

Ej (p 


+ exp 


2fe^(g) 

Eg(p 


Also suppose that 


Kf (p >E,fj,g (p and Mg (p >'Ef^:g (p if T > 1, 
Mf (p <Mf^g (p and MgCp <Mf^g (p if t <1. 

and the following inequality holds: 


2h'^if*g)>2XhJ{f) + 2{l-X)h'^ig) 

—Mf (pX log A — Eg (p{l — X) log(l — A), 


where X G [0,1] is given by 


X = T ^ exp 


2fe^(/) 

Mf (p 


Then Eqn (11.21) holds true for independent RVs Xi and X 2 where Xi f,X2 

9 ’ 


( 1 . 8 ) 


(1.9) 


( 1 . 10 ) 


Remark. The arguments developed in Section 1 do not use the fact that RVs Xi and 
X 2 possess PDFs. The question of whether the WEPI (as it is presented in Eqn (|1.2I) or in 
a modified form) may hold for cases of discrete distributions requires a separate investigation. 
However, constructions used in Section 3 demand existence of PDFs fx^ and /xj although some 
of their technical parts are valid in a more general situation. 
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2 Examples and counterexamples 

In this section we give several examples where the above inequalities hold or do not hold true. 


2.1. Examples. First, let us discuss specihc conditions equivalent to (II.2p . (II.5p or (jl.6p . for 
various pairs of RVs. In the next subsection we present results of numerical simulations showing 
domains of parameters where Eqns (II.2p . (|1.5I) and (|1.6p are fulfilled or violated. 


2.1.1. (Normal distributions) Let Xi, X 2 be two independent normal RVs: Xi ~ N(0,cr^), 
X 2 ~ N(0,(T2) and X ~ N(0,iTf + a^)- Recall (see [3, Example 3.1), the WDE h^{Z) of a 
normal random variable Z ~ N(0, a^) reads 

k;{Z) = + ig^EzV(^); 

we will use it for Z = V, Vi, V 2 . The condition k > (<)1 is re-written as 


We have to match it with inequalities 


+ (T 2 exp 


e[v|(/>(V2)] ] 

CTiE0(V2) / 


>(<)(2vr)-^ 


( 2 . 1 ) 


E,^(Vi), E,/.(V2) > (<)E0(V) 

to fulhll (II.Sp 

To specify the WLSI (11.61) , we write: 

1 
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27r(T^ 
(cos a)' 




Pluging-in the definition of (pc' 

EMYi) = mxi), E[Y,^(Pc{Y,)] = . 

I COS (y. j 

Similar equations hold for h'^^{Y 2 ). Then Eqn (|1.6I) takes the form 
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(2.3) 


2.1.2. (Gamma-distributions) Let Xi and X 2 have Gamma distributions, with PDFs fxi{x) = 

\/3 

z = 1, 2, and fx{x) = . ^ x > 0 where /3 = /3i + /32- The WDEs are 

[Pi) i [p) 

hJiXi) = (1 - log w] + XE[Xi(P{Xi)] + log EcPX) 
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and similarly for X (with /3 instead of /3i). The condition k > (<)1 reads 

_ f XE[Xicj>{Xi)] - (A - l)E[,/.(Xi)logXi]', 

E0(Xi) i 

, _ f AE[X2</.(X2)] - (/32 - l)E[<?i(X2)logX2] I ^ 

J e4){X2) I -{-) > 


(2.4) 


as above, it has to be in conjunction with E</>(Xi),E^(^ 2 ) > (<)E(/>(X). The WLSI (11.61) takes 
the following form: 


log ^^E 0(X) - (/3 - 1)E[^{X) log X] + AE[X0(X)] 


A/3 

> (cos a)' 
+ (sina)" 


XE[Xicj){Xi)] - (/3i - l)E[</.(Xi)logXi] 
XE[X2(^{X2)] - {h - l)E[<(.(X2)logX2] 


+ E<()(Xi)log^^^'^ 


+ e4){X2) log 


cos a 

r(/^2) ^ 

a/ 32 sin a 


(2.5) 


2.1.3. (Exponential distributions) Let Xi and X 2 be two independent exponential RVs, 
with means Aj~^ and A^^, and WDEs h^{Xi) = (Ajlog Ai)E(()(Xj) + EXi(j){Xi), i = 1,2. See [7], 


A 1 A 2 


Example 3.2. Then fx{x) = ^ ^ The inequality k > (<)1 becomes 


Ai — A 2 


A 2 exp 


f2XiE[XicP{X,)]] , ^2 f 

1 E 4 .(X,) |+^vxp| 


2 A 2 Ex2[-^2</>] 

Ecj){X2) 


> (<) A 1 A 2 


and to fulhll Eqn (|1.5I) it has to be combined with 

AiE())(X2) - A2E(()(Xi) 


E<f>{Xi), E(j){X2) > (<) 

In this example, the WLSI (11.61) reads 
log A 1 A 2 


Ai — A 2 


Ai — A 2 


{A2E0(Xi)-AiE</.(X2)} 
Ai 




4){Xi)\og 
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-E 


(('(^ 2 ) log 


g— A 2 X 2 _ g— A 1 X 2 

Ai — A 2 


g—A2Ari _ g—AiXi 

Ai — A 2 


> Ai(cos a)^ E[Xi(()(Xi)] — (cos a)^E 0(Xi) log(Ai cos a) 

+A 2 (sina)^E[X 2 (/>(X 2 )] — (sina)^E(/i(X 2 ) log(A 2 sin a) 


( 2 . 6 ) 


(2.7) 


( 2 . 8 ) 


2.1.4. (Uniform distributions) Set 4'(x) = f ^(u)du, d>*(x) = f u(f>(u)du. Let Xi ~ U(ai, 6 i) 

0 0 

and X 2 ~ U(a 2 , 62 ), independently, where Li := bi — ai > 0, i = 1,2. The WDE h^{Xi) = 

—^ log Lj. Suppose for dehniteness that L 2 > Li or, equivalently, Ci := 02 + 61 < 
Li 
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CLi + b 2 =■ C 2 - Then PDF fx for X = Xi + X 2 has a trapezoidal form with corner points at 
A = ai + 02 , Cl, C 2 and B = hi + b 2 ' 


fxix) = X < 

L 1 L 2 


0, if X < ^ or X > i?, 

X — ^4, if < X < Cl, 

Li, if Cl < X < C 2 , 

B — X, if C 2 < X < B. 


The condition k > (<)1 takes the form 

Li + L2> (<) 1. 

Consider the quantity A (which may be as positive as well as negative): 


A = 


log Ti 
L 2 


4>(Ci) - <h(C2) 

Cl 
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LiL 


1-02 


pUi pB 

/ (()(x)(x — A) log(x — A) dx + / (j){x){B — x) \og{B — x)d. 

Ja Jc2 


— X ax 


Then 


E(j){X) = 


L 1 L 2 


$*(Ci) - $*(A) - ^*{B) + $*(C2) 


-A 


$(Ci) - $(A) 


+ Ti 


d>(C2) - d>(Ci) + B ^{B) - d>(C2) 


To satisfy condition (ll.Sp . we have to assume that 

L2[4>(fei)-4>(ai)], Li[$(62)-4>(a2)] >(<)E(/.(X), 

in conjunction with bound (12.91) . 

The WLSI (|1.6I) becomes 

hJ{X) = -A+[log (LiL2)]E0(X) 

1 -^1 I / ■ n 2 — 4>(a2) L 2 

> (cos a) ---log-h (sm a) ---log ^— 


Li 


cos a 


L 2 


sm a 


(2.9) 


( 2 . 10 ) 


( 2 . 11 ) 


( 2 . 12 ) 


2.1.5. (A mixed case) Let Xi be a Gamma RV with PDF fx\{x) = 


A/' 

r(/3) 


X' 


and the 


cumulative distribution function Fx^ (x). The WDE K^{Xi) has been specified in Example 2.1.3. 
Take RV X 2 from the uniform distribution U(a,6), where L := 6 — a > 0, independent of Xi. 
The WDE K^{Xi) has been specified in Example 2.1.4. We can write 


fx{t) = -j- Fxi (t - a) - Fxi (t - b) 
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As in Example 2.1.3, let <l>(x) = Jq (/>(u)du. Next, set: 


0 = 


Then 


1*00 P 

/ ^(x) [Fxi (x-a) - Fxi (x - b)] log Fx^ {x - a) - Fx^ {x - b) 

Jo L 

log(Lr(/3)) 


dx. 


(2.13) 


h^i^) = 


xE 


L 

$(Ai + 6)1 (A:i > -b) - ^{Xi + a)l(Xi > -a) 


The quantity k is specihed by 
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exp 


fr{/3)\\_ iXE[X,(j){X^)] - (/3 - l)E[<).(Xi)log Ai] 

Ki — I :::— I 0 X 13 -^^- 
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T' 
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(2.14) 


(2.15) 


V A/3 y E</.(Ai) 

Note that if 6 — a > 1 we always have k > 1. To fulfill condition (|1.5p . we have to assume that 

f LE().(Ai) > (<)E[$(Ai+ 6) - 4>(Ai+a)] 


[ 4>(6) - 4>(a) > (<) E[4>(Ai + b) - ^{Xi + a)] 
The WLSI (II.6p takes the form: 


depending on k > (<)1. 


(2.16) 


h^{X) := log[Lr(/3)] E $(Ai + 6)l(Ai > -b) - 4>(Ai + a)l(Ai > -a) 


> L(cos ay 
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+(sma)^—^- — log 
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cos a 


- 0 


M{Xi) 


(2.17) 


sm a 


-1 


2.1.6. (Cauchy distributions) Let Ai, A 2 be independent, with PDFs fx {x) = i'^Sj) 

1 ^ 

1 + (x — fijy/O'j , X G M, j = 1 , 2 . Then fxj{x) is f the same form, with parameters 

p = pi + /r 2 and 0 = 61 + 02 - For the WDEs hy{X) we have the formula 
hyiX) = E 0(A) log(7r0) + E [0(A) log(l + (A - 
and similarly for hy{Xi). The condition n > (<)1 is re-written as 


9? exp I 


f 2E[0(Ai)log(l + (Ai-/ri)Vg^)] -( 
E0(Ai) J 

r 2E[0(A2) log(l + (A 2 - li 2 ?/ 0 l)\ 


+62 exp / 
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}>(<) 
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(2.18) 


TT 


to satisfy (|1.6p we have to match it with K(j){X 2 ) > (<)E0(X). The WLSI (|1.6p reads 

E 0(A) log(7r0) + E [0(A) log(l + (A - 

> (cosa)^E [0(Ai)log(l + (Ai -/ri)2/6»i] + (cos a)^E 0(Ai) log(2.19) 


cos a 


-F(sina)^E [0(A2) log(l (A 2 - lX 2 f/ 02 )] + (sina^)E0(A2) log — 


7r02 


sm a 
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2.1.7. (A distribution with an infinite SDE) Here we take independent Ai, A 2 ~ g where g 
is a PDF on (1, 00 ): 


gix) = 
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x[(ln x)2 + 1 ] 


X > 1. 


Here we have that 


fxit) = jg{t- s)g{s)ds = 


{t - s) 


1 + (ln(t — s))2 


1 + (lns)2 


ds. 


Therefore 


hJiX) 
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(x- s) 


rx—1 


X log 


1 + (ln(x — s))2 
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1 + (lns)2 


ds 


^ (x — w) 


1 + (ln(x — w))'^ 
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1 + (lntt;)2 


■dw 


dx, 


( 2 . 20 ) 




assuming that WF (j) decreases fast enough so that the integral in (12.201) absoltely converges. 
The bound k > (<) 1 now reads: 


2E 


exp 


(/)(Ai)log{Ai[l + (lnAi)2 + l]} 






( 2 . 21 ) 


and we again have to match it with inequality E())(Ai), E())(A 2 ) > {<)M(f){X). 
The WLSI (11.6j) takes the form: 

rx—1 


/•cxD pa 
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(x - s) 


nx—l 


X log 


1 + (ln(x — s))2 
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1 + (lns)2 


ds 


^ {x — w) 


1 + (ln(x — w)Y 
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1 + (lntc)2 




^dw dx 




( 2 . 22 ) 


> E[cj){X,) log Ai] + e{<).(Ai) log [1 + (In Ai)2)] } 

—E(/)(Ai) (cosa)^ log cos a + (sina)^ log sin a 


2.2. Numerical results. As was said, in this subsection we comment on some numerical 
evidence that (i) Fqn (II.2h does not always hold true, and (ii) assumptions (ll.5|l (II.6h in Theorem 
1 are not necessary for the WFPI (11.211 . Our observations are of a preliminary character, and we 
think that further numerical simulations are needed here, to build a detailed picture. 
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2.2.1. (Normal distributions) Assume that Xi and X 2 are normal RVs as in Example 2.1.1. 
Choose 4>{x) = \x^ — 2|. The graph in Figure 2.2.1 presetns the difference between the RHS 
and the LHS in (II.2p : when this difference is non-negative, the WEPI is satisffed, otherwise the 
WEPI fails.The graph shows that there is a domain of parameter (<ti,(T 2 ) where Eqn (II.2p does 
not hold. Additional simulations state that there is a domain where dn holds and only one 
of Eqns (jl.Sp . (II.6p is satisffed. For example, in the square where 0.55 < (Ti,(J 2 < 0.551 the 
condition m is violated but (|1.5I) . (|1.2p hold true. 

2.2.2. (Gamma distributions) Assume that Xi and X 2 are gamma RVs as in Example 2.1.2. 
Here we choose (p{x) = xe~^. The graph in Figure 2.2.2 again shows the difference between the 
RHS and the LHS in (|1.2I) : Here the WEPI is satisfied (in the presented range of parameters 
(/3i,/32)). As in Example 2.2.1, additional simulations assert that there is a domain where (II.2p 
holds while none of (|1.5p . (|1.6I) is satisfied. For example, in the square 0.01 < /3i < 0.1 and 
5 < /32 < 6.1 both conditions dLS]), (US]) are violated but (II.2p holds true. 




Figure 2.2.1 


Figure 2.2.2 


3 WDE and an additive Gaussian noise 

3 . 1 . Integral representations for WDEs. Following [8], [3], the WLSI (|1.6p can be re-written 
(under certain conditions on /xj, fx 2 </>) in terms of integral representations of the entropies 
h^{X), and hJ^{Y 2 ): cf. Eqns (|3.4p . (13.5p below. Despite its cumbersome appearance, 

formulas ()3.4p and ()3.5p have an advantage: they does not include logarithms. (However, note 
condition (I3.2p .l Throughout the presentation in this section, the reader can notice persistent 
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similarities with [3]. 

In this section we work with a two-variable WF {x,y) G M x M i—>■ p{x, y) >0 and a number 
of reduced WDEs involving various integrals of p. Let Z and N be two independent RVs, where 
N ~ N(0,1) with standard normal PDF /^°, while Z has a PDF fz- Following |8] and |3], 
RV Z will represent a signal and N an (additive) Gaussian noise; RV Z will be a pre-cursor for 
X = Xi -|- X 2 , Yi and 12- Given 7 > 0, 7 / G M, set: 


vz{y,i) = 
Cz{x,y,-f) = 


j {y- - iV^)fzit)dt 

I f^iy-zy^)fziz)dz 

Uy - w^)wf^''{y - Wy/^)fz{w)dw 

J f^°{y - zV^)fz{z)dz 

p[x,v){v - Xy/^)x- - - --du. 

-00 Jz,z^+N[x,y) 


(3.1) 


Theorem 3. Let Xi, X 2 , N and N' be independent RVs, with X = Xi-\-X 2 , where (i) Xj are 
with bounded and continuous PDFs fxj such that IE| log/jv(^)| < 00 and E| log fxj{Xj)\ < 00 , 
j = 1, 2, and (ii) N, N' ~ N(0,1). Assume that for Z = Xi, Z = X 2 and Z = X, the conditional 


expectation E 


fz{Z + 


N-N’ 


V7 


Z,N 


is such that, for some integrable RV xiZ, N) > 0 


logE 


fz{Z + 


N -N’ 




Z,N 


<xiZ,N). 


(3.2) 


Next, consider a WF {x,y) G M x M 1 -^ p{x,y). Suppose that p is continuous and bounded. 


and V X G M, 3 a limit 4>{x) = lim p{x,y). Introduce additional WFs 

y—>-±oo 

Pc{x,y) = p{xcosd,y), ps{x,y) = p{xsmd,y), with (l)c/s{x) = ^]im^pc/s{x,y), 
^*(x) = f p(x,v)fx(x)dx, = / Pc(x,v)fY^(x)dx, (j)Uv) = / Psix,v)fY 2 {x)dx 


(3.3) 


where Y 2 , I 2 are as in (ll.3p . 

Then, the WDE {X) of the sum X = X 1 +X 2 in the RHS of (jl.hp admits the representation 

r*oo 2 


^ E [Cx (X, X^ + N, 7 ) ix{x^ + N, 7 ) 


-p{X,X,yX + N)px 


+ N,j 


d7 + h^*(iV). 


(3.4) 


On the other hand, for K^^{Yi) and K^^{Y 2 ) we have the respective formulas 
^ E Cyj (Yj ,Yj^ + N, 7) Cv V7 + 7) 


-p\Zj,Yjy/^ + NlpYAYjy/x + N,x) dx + hJ*{N), 3 = 1,2. 


(3.5) 
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The proof of Theorem 3 uses two technical assertions, Lemmas 3.1 and 3.2. They address the 
cases 7 = 0 and 7 ^ oo (that is, the integration endpoints in (13.4h and (13. 5p ). For the definition 
of the weighted conditional and mutual entropies, see Eqns (1.11), (1.12) in jTj. 

Lemma 3.1. (Cf. Lemma 2.4 in [1].) Let Z, U he independent RVs. Assume that U has 
a bounded and continous PDF fu G C°(M'^); f fir(x)dx = 1 and ess sup[/; 7 (x), a: G M'^] < + 00 . 
The distribution of Z may have discrete and continous parts; we refer to the PMF fz(x) relative 
to a reference measure ly(dx). Next, suppose that a bounded WF {x,y) G M x M 1 — p{x,y) has 
been given and assume that E| log fz{Z)\ < + 00 . Consider the weighted mutual entropy (WMF) 
ij {Z : ^JyZ + [/) between Z and ^Z + U where 7 > 0 is a parameter. Then 

lim zj(Z : ^Z + C/) = 0. (3.6) 


Proof. According to the definition of the WME, for a pair of RVs Z, V with a conditional 
PDF fv\z{y^x) we have an equality involving a weighted conditional entropy (WCE) 


iJ{Z : V) = h^^{Z) -h^{Z\V) where ipzix) = j p{x,y)fy\z{y\x)dy. 
Setting V = y/yZ + U, we can write a representation for the WCE: 


h-p{Z\^Z + U) 


Kx,y)fu{y - y/jx)fz{x) 


X log 


Jfujy - Viz)fz{z)dz 
frrlv — ^Pyx) fz(x) 


dyi'(dx}. 


Using that p and fjj are bounded, with the help of the Lebesgue dominated convergence theorem 
we have that as 7 ^ 0, the ratio under the log converges to [fzix)]~^. Consequently, 


limh^iZly/yZ + U) = h^,^{Z) where tp*z{x) = j p{x,y)fuiy)dy. 


Moreover, with '4’z'yi^) 


P{x,y)fu{y - Vix)dy, we introduce: 


= - j pix,y)fu{y - Vlx)fz{x)logfzix)dyu{dx). 

At this stage we again apply the Lebesgue dominated convergence theorem and deduce that 
lim (Z) = /iT* (Z). This leads to (13.61) . □ 

“z,7 Vz 


Lemma 3.2. (Cf. Lemma 4.1 in H].) Let Z, Lf and U' he independent RVs, Z with a PDF 
fz und Lf, Lf with a PDF fjj. As before, consider a WF {x,y) G M x M 1 —)• p{x, y). Suppose that 
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fz and p are continuous and bounded, and there exists a limit 

that for some RV x{^i U) > 0 with Ex(^, U) < oo, we have 
x{Z,U). Then 


p{x) = 
logE 


lim p(x,y). Next, assume 

y—>-oo 



U-U'\ 

) 


z,u 


< 


K^iZ) = lim [C(Z : + U) + Kl, ([/)] where 

log fu{U) and = J p{x,u + y/^x)fz{x)dx. 


Proof. We can write 

iJ{Z:^Z + U) + h^.^jU) 

= - j p{x, U + y/ix)fu{u)fz{x) log 

Passing to the limit 7 —?> oo, Eqn (j3.8p yields (j3.7p . again owing to the Lebesgue dominated 
convergence theorem. □ 


fu{v)fz X + 


u — V 


V7 


dr; 


dudx. 


(3.8) 


Proof of Theorem 3. We again use Z as a substitute for RVs Y), Y 2 and X = Xi + X 2 ■ 
Given 7 > 0, write the joint WDE for Z and Z 77 + N: 


h^{Z,Z^ + N) = - j p{x,x^ + v)f °{v)fzix)logf “(ujdxdr; 

- / pix,Xyfx + v)f^°iv)fzix)logfzix)dxdv = (Z) +/i^a) (N). 

J '^Z,7 ^iV,7 


(3.9) 


Here and below, V 7 ,0 > 0, 

V'z,7(®) = J P{x,Xy/j + v)f^°{v)dv, = J p{x,x'/e + v)fz{x)dx, (3.10) 

with {X) = — J f p{x,xV 0 + v)fz{x)dx f^°{v)log f^°{v)dv. 

pN,e 1 1 

Moreover, according to Lemma 3.2 (with U = N, U' = N'), V e > 0 we have 


r°° d 

h^{Z)= — [i;{Z : ZV7 + iV) + hX,, (iV)]d7 + Xp{Z : ZVl +N) + hX,, {N). 

Je ^7 ^N,'y y^N,e 


To analyze the WDE h^( 2 ) (-^)? Lebesgue's dominated convergence theorem. This yields 




lira hX 2 ) (N) = hX{N) where Pn{v) = f pix,v)fz{x)dx. 

In addition we get that the WME iJ{Z : Z 77 + N) is represented as the difference 


hpiZ^ + N) - /i^a) {N) with V'(x) = / p{x,v)f^°{v - ^x)dv. 
'^iV,7 J 


(3.11) 
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/0\ 

Note that see (13.71) . Furthermore, owing to Lemma 3.1 (with U = N), we write: 

/■oo ^ 

hp{Z) = J —h^{Zy/^ + N)dj + h'^*^{N), still with. p{x)= l^p{x,y). (3.12) 

We are now going to analyze the derivative + N) representing it as 


dy 


p{x, y)f^°{y - xy/^) fz{x) log 


1 


/^°(y - tVi) fz{t)dt 


dxdy 


2^7 
X log 

1 


pix, y)fz{x)f^°{y - Xy/j){y - x^)x 


f (y - tVl) fz{t)dt 


dxdy 


(3.13) 


2^7 


P{x, y)fzix)f^°{y - XyPy) 


f w(y - w^)f^°(y - wy/j)fz(w)dw 


dxdy. 


//^°(y - z^)fziz)dz 

The hrst integral in the RHS of (j3.13p is done by parts. This leads to the following expression: 

1 f ry 


2^7 


2^7 


p{x,v)fz{x)f^°{v - x^/y){v - xv^)xdxdx 

f(y - t^)yf^°(y - t^)fz(t)dt l 
f f^°(y - z^)fz(z)dz J ^ 

’/ (y - wV7}wf^°(y - w^)fz(w)dw 


P(x, y)fz(x)f^°(y - xy/j) 


J f^°{y - Zy/j)fz{z)dz 


dxdy. 


Then, taking into account Eqn (j3.ip . 

C{x, y, 7)C(y, 'y)fz,z^+N{x, y)dxdy 




2^7 


P{x, y)viy, 7 )fz,z^+N{x, y)dxdy 


(3.14) 


2^7 


E Cp{Z, Z^ + N)i{Z^ + 7) - P{Z, Z^ + N)p{Z^ + 7) • 


□ 


3.2. WLSI for a WF close to a constant. Concluding this section, we analyze the WLSI 
(jl. 6 p when the WF (j) lies in vicinity of a constant (p (and hence, is bounded). Given independent 
RVs Xi, X 2 with PDFs fxi and /xj, we refer to Yi and Y 2 as Yi = Xxj cos a, Y 2 = Al 2 /sina 
where a £ [—tt, vr) is as in Eqn (II. 3F Eor Z = 1 ^ 1,12 or Xi + X 2 = Yi cos a + Y 2 sin a, set: 


M{Z]J) =e[|z-e(z|zv^ + a^)|^ 


(3.15) 


and suppose that for the above choices of RV Z: 


E|ln/z(Y)| < 00 . 


(3.16) 
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We also need to assume a uniform integrability condition (|3.2I) : for an independent triple Z, N, N' 
where N,N' ~ N(0,1), there exists an integrable RV x(Z, A^) > 0 such that 



r / N-N’\ 

~ 

logE 

fz{z + -— 

Z,N 


L V J 



<X{Z,N). 


(3.17) 


According to formula (4.5) in [5, for these choices of Z, the standard SDE h{Z) is represented 


as 


h{Z) = h{N) + - 


M { Z ,' y ) - 1(7 > 1)- 


7 


d7. 


(3.18) 


Furthermore, as follows from the proof of Theorem 4.1 in jTj (see H], Eqn (4.8)), for any a G 
[— 7 r, 7 r] (including a = a, the value from (11.31) 1. 


M{Yi cos a + Y 2 sin a, 7 ) > M(li, 7 )(cos a)^ + M(l 2 , 7 )(sin a)^. 


For a = a, this becomes 

M(Xi +^2,7) > M(yi,7)(cosa)2 +M(y2,7)(sma)2. (3.19) 


Now we are in position to establish Theorem 4 below. As before, we refer to Z = Yi,!^ or 
Xi + X 2 = Yi cos 0 + 12 sin a. 


Theorem 4. Let 70 > 0 be is a point of continuity of M (Z, 7 ), Z = Ti, Y 2 , Xi+ X 2 . Suppose 
that there exists <5 > 0 such that 

M{Xi + A 2 , 7 o) > M(Ti, 7 o)(cosa)^ + M(l 2 , 7 o)(sina)^ + <5. (3.20) 

Also assume (I3.16P and (j3.17l) . 

Then there exists e = €{^ 0 , 6 , fxi, fx 2 ) with the following property. Let function x G M 
(/>(x) > 0 be such that \(t>{x) — (/>| < e, V x, for a constant c/) > 0 . Then the WLSI (11.61) with the 
WF (j) holds true. 

Proof of Theorem 4. According to Theorem 1, to prove the WSLI (II. 6 p . we only need to 
check that 


{cosafh'^^{Yi) + (sinQ;)^/i^g(l 2 ) < /i^(Ti cos a ++2 sin a). 

For a constant WF cj), the following inequality is valid (see Ref [4], Lemma 4.2 or Ref [ 8 ], Eqns 
(9) and (10)) 

(cosa)^/i^(yi) + (sina)^/i^(l 2 ) < cosa + I 2 sina). 
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Next, Theorem 4.1 from [4] (applicable because of (13.161) and (13.171) 1 implies that under condition 
(j3.20j) . for e small enough 


{cosa)^h^{Yi) + (sina)^/r^(l 2 ) + e < cosa + Y 2 sina). 

Define (p{x) = \4>{x) — </>l. It remains to check that 

h^{Yi) < e/ 3 ,/i^(T 2) < e/ 3 ,/i"(yicosa +Y'2sinQ;) < e/ 3 . 

But this inequality immediately follows, owing to (I3.16|) . This competes the proof of Theorem 
4. □ 


The statement of Theorem 4 can be made more efficient for given PDFs fxi and fxi ■ As an 
example, consider the case where RVs Xi, X 2 are normal and WF (p £ C'^. 

Lemma 3.3. Let RVs Xi ^N[ni, a'‘f),i = 1,2 be independent, and X = Xi + X 2 ~ 

N(|Ui + p,2,(^I + (^ 2 )■ Suppose that WF x E M (p{x) > 0 is twice contiuously differentiable and 
slowly varying in the sense that V x, 

\(p''{x)\ < e(j){x), |(/)(x) - 01 < e, (3.21) 

where e > 0 and 0 > 0 are constants. Then there exists cq = eo{po,fii, aQ,af) > 0 such that for 
any 0 < e < eg, the WLSI (12.3p with the WF 0 holds true. 


Proof of Lemma 3.3. Let a be as in Eqn (|1.3I) : to check (|2.3I) . we use Stein’s formula: for 
Z~N(/r,a2), 


E 


=ct2E0(Z) +(j%0"(Z) 


(3.22) 


Owing to the inequality |0(x) — 0| < e. 


a < oo = tan ^ (^exp |(0 + ef[h+{X 2 ) - h-{Xi)] - (0 - ef[h+{Xi) - /i_(A 2 )]|)- 


Here 


h±{Xi) = -E l{Xi E A*±)log/i^°(Xi) 


f = 1,2, 


and 


= 


{x E M : f!^°{x) < 1 }, = {x E M : /f°(x) > l}. 


Evidently, under conditions |0'(x)|, |0"(x)| < e0(x) we have that oq < f — e and 0 < e < 
(sina)^, (cosa)^ < 1 — e < 1. We claim that inequality (12.3p is satisfied with 0 replaced by 0 
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and added <5 > 0: 


log hniaf + (t| 




> (cos a)^ 
+ (sma)^ 


log 


2707^ 
(cos a)^ 


aj + aj 


— (cos a)^ log e — 


<P + 


(Tt 


<pmt] 


(3.23) 


27r(Tn '' 

log-TT-^ 

(sin a)^ 


:+ (™°)!i°g^ ?E|x|] + ^. 


(To 


Here (^ > 0 is calculated through e and increases to a limit (5o > 0 as e ^ 0. 
Indeed, strict concavity of log y for y > 0 implies that 


log (2Tr(af + > (cosa)^ 


log 


27rcjf 
(cos a)^ 


(/> + (sina)^ 


log^T 


27 r cr: 


2 1 


(sin aY 


+ 6 . 


On the other hand, 


<^IE[x2] = <to^Xl] + <))E[X|]. 

Now, if we look at Eqn (12.3p with WF (p then, owing to Eqn (I3.23P it suffices to verify that 

log e 

-cp)^ - 
0 
a 


log (2T:{al+<jl))\nY{X) -</>) + ¥.[X\(P{X) - p)] 

\ /J O’ (J 2 


— (cos aY 
— (sin oY 


E((/>(Xi )-(/>) + 


(cos aY log e 


(cos aY 
, 271(7.^ 

log 




mmxY - 


(3.24) 


(sin a) 


2 E((/>(X2) - <^) + E[X|(0(X2) - </.)] < <5. 


(To 


We check this by a brute force, claiming that each term in (|3.24p has the absolute value < <5/6 
when e is small enough. For the terms containing E(^(Z) -</)), Z = X, Xi, X 2 , this follows since 
\(p{x) -p\<e. 

The terms containing factor E[Z^((/(Z) —</>)] we use Stein‘s formula (I3.22h and the condition 
that \(p''{x)\ < e4>{x). □ 


Similar assertions can be established for other examples of PDFs fxi and fx-^- 
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